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METHOD AND APPARATUS FOR HIGH-SPEED 
PARSING OF NETWORK MESSAGES 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates generally to the field of computer networks, and 
more specifically, to a mechanism for performing pattern matching on network messages 
at high speed. 

Background Information 

Enterprises, including businesses, governments and educational institutions, rely 
on computer networks to share and exchange information. A computer network typically 
comprises a plurality of entities interconnected by a communications media. An entity 
may consist of any device, such as a host or end station, that sources (i.e., transmits) 
and/or receives network messages over the communications media. A common type of 
computer network is a local area network ("LAN") which typically refers to a privately 
owned network within a single building or campus. In many instances, several LANs 
may be interconnected by point-to-point links, microwave transceivers, satellite hook- 
ups, etc. to form a wide area network ("WAN") or subnet that may span an entire city, 
country or continent. One or more intermediate network devices are often used to couple 
LANs together and allow the corresponding entities to exchange information. A bridge, 
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for example, may be used to provide a "bridging" function between two or more LANs. 
Alternatively, a switch may be utilized to provide a "switching" function for transferring 
information between a plurality of LANs at higher speed. 

Typically, the bridge or switch is a computer that includes a plurality of ports, 
which may be coupled to the LANs. The switching function includes receiving data at a 
source port that originated from a sending entity, and transferring that data to at least one 
destination port for forwarding to a receiving entity. Conventional bridges and switches 
operate at the data link layer (i.e., Layer 2) of the communications protocol stack utilized 
by the network, such as the Transmission Control Protocol/Internet Protocol (TCP/IP) 
Reference Model. 

Another intermediate network device is called a router. A router is often used to 
interconnect LANs executing different LAN standards and/or to provide higher level 
functionality than bridges or switches. To perform these tasks, a router, which also is a 
computer having a plurality of ports, typically examines the destination address and 
source address of messages passing through the router. Routers typically operate at the 
network layer (i.e., Layer 3) of the communications protocol stack utilized by the 
network, such as the Internet Protocol (IP). Furthermore, if the LAN standards associated 
with the source entity and the destination entity are different (e.g., Ethernet versus Token 
Ring), the router may also re-write (e.g., alter the format of) the packet so that it may be 
received by the destination entity. Routers also execute one or more routing protocols or 
algorithms, which are used to determine the paths along which network messages are 
sent. 

2 
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Computer networks are frequently being used to carry traffic supporting a diverse 
range of applications, such as file transfer, electronic mail, World Wide Web (WWW) 
and Internet applications, voice over IP (VoIP) and video applications, as well as traffic 
associated with mission-critical and other enterprise-specific applications. Accordingly, 

5 network managers are seeking ways to identify specific traffic flows within their 
networks so that more important traffic (e.g., traffic associated with mission-critical 
applications) can be identified and given higher priority to the network's resources as 
compared with other less critical traffic (such as file transfers and email). In addition, as 
computer networks get larger, there is also a need to balance the load going to various 

10 servers, such as web-servers, electronic mail servers, database servers and firewalls, so 
that no single device is overwhelmed by a burst in requests. Popular Web sites, for 
example, typically employ multiple web servers in a load-balancing scheme. If one 
server starts to get swamped, requests are forwarded to another server with available 
capacity. 

15 Layer 4 switches or routers have been specifically developed to perform such 

services. In a Layer 4 switch, the device examines both the network and transport layer 
headers of network messages to identify the flow to which the messages belong. Such 
flows are often identified by examining five network/transport layer parameters (i.e., IP 
source address, IP destination address, source port, destination port and transport layer 

20 protocol). By examining these five parameters, a layer 4 switch can often identify the 
specific entities that are communicating and the particular upper layer (e.g., Layer 7) 
application being used by those entities. In particular, a defined set of well-known port 
numbers has been established at Request for Comments (RFC) 1700 for certain common 
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applications. For example, port number 80 corresponds to the hypertext transport 
protocol (HTTP), which is commonly used with WWW applications, while port number 
21 corresponds to the file transfer protocol (FTP). 

The parsing of data packets so as to identify these network/transport layer 
5 parameters is typically performed in software by a dedicated module or library. The 

Internetwork Operating System (IOS®) from Cisco Systems, Inc. of San Jose, California, 
for example, includes software modules or libraries for performing such packet parsing 
functions. A processor, such as a central processing unit (CPU), at the network device 
executes the corresponding program instructions. These modules or libraries may be 
10 written in any number of well-known programming languages. The Perl programming 
language, in particular, is often selected because of its highly developed pattern matching 
capabilities. In Perl, the patterns that are being searched for are generally referred to as 
regular expressions. A regular expression can simply be a word, a phrase or a string of 
characters. More complex regular expressions include metacharacters that provide 
15 certain rules for performing the match. The period ("."), which is similar to a wildcard, is 
a common metacharacter. It matches exactly one character, regardless of what the 
character is. Another metacharacter is the plus ("+") symbol which indicates that the 
character immediately to its left may be repeated one or more times. If the data being 
searched conforms to the rules of a particular regular expression, then the regular 
20 expression is said to match that string. For example, the regular expression "gauss" 
would match data containing gauss, gaussian, degauss, etc. 

Software modules and libraries can similarly be written to search for regular 
expressions beyond the five network/transport layer parameters described above. In 
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particular, some enterprises wish to identify network messages that are associated with 
applications that have not been assigned a well-known port number. Alternatively, an 
enterprise may be interested in identifying messages that are directed to a specific web 
page of a given web site. An enterprise may also wish to identify messages that are 
5 directed to or carry a particular uniform resource locator (URL). To identify such 
messages, an intermediate network device must examine more than just the five 
network/transport layer parameters described above. That is, the actual data portions of 
the message(s) must be parsed for specific patterns, such as selected URLs. 

It is known to incorporate software modules or libraries that have been 
10 programmed to perform such search requests into servers. However, the evaluation of 
individual packets through software is an impractical solution for intermediate network 
devices, many of which receive and process far greater volumes of traffic than servers, 
due to the increasing size and complexity of modern networks. That is, today's computer 
networks can generate hundreds if not thousands of diverse traffic flows at any given 
15 time. The use of advanced network equipment, such as fiber optic transmission links and 
high-speed transmission protocols, such as "Gigabit" Ethernet, which is intended to 
support transmission speeds up to 1000 Mbps (i.e., 1 Gbps), further increase the speeds of 
these traffic flows. Furthermore, regardless of the processing power of the device's CPU 
(e.g., 16, 32 or even 64 bit), regular expression matching can only be performed 1 byte at 
20 a time, due to programming constraints. 

Thus, the current software solutions for performing regular expression matching 
are becoming less efficient at performing their message processing tasks as transmission 
rates reach such high speeds. Accordingly, a need has arisen for performing regular 
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expression matching at the high transmission speeds of current and future computer 
network equipment. 

SUMMARY OF THE INVENTION 

Briefly, the invention relates to a programmable pattern matching engine for 

5 efficiently parsing the contents of network messages for pre-defined regular expressions 
and for executing actions on messages that match those expressions. The pattern 
matching engine is preferably a logic circuit designed to perform its pattern matching and 
execution functions at high speed, e.g., at multi-gigabit per second rates. The pattern 
matching engine preferably includes, among other things, a regular expression storage 

10 device for storing the pre-defined regular expressions and the actions that are to be 

applied to messages matching those regular expressions, a message buffer for storing the 
current message being evaluated, and a decoder circuit for inputting the network message 
or portions thereof to, and for decoding and executing identified actions returned by the 
regular expression storage device. In a novel manner, the regular expression storage 

15 device includes one or more content-addressable memories (CAMs) that contain at least 
the pre-defined regular expressions. The corresponding actions may either be stored 
along with the regular expressions within the CAM or they may be stored within a second 
memory device, such as a random access memory (RAM), that is associated with the 
CAM. Association between the CAM and RAM is achieved by having each CAM entry 

20 identify and thus correspond to the specific RAM entry that contains the action to be 

applied to messages matching the regular expression contained in the respective CAM 

entry. The pattern matching engine, moreover, is configured such that the RAM provides 

its output to the decoder circuit, which decodes and executes the action contained therein. 
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In the illustrative embodiment, the pattern matching engine further includes a 
barrel shifter operating under the control of the decoder circuit and coupled to both the 
message buffer and the CAM. The barrel shifter essentially provides a moveable window 
for revealing a selected portion of the message currently stored in the message buffer. In 

5 operation, the decoder circuit operates the barrel shifter so as to input selected message 
portions to the CAM. The CAM compares each inputted message portion to all of its 
entries at the same time and identifies the first matching entry. The matching CAM entry 
identifies a corresponding RAM entry the contents of which are provided to the decoder 
circuit. The decoder circuit decodes the action returned by the RAM and applies that 

10 action to the message. The entries of the RAM, for example, may contain actions or 
instructions to continue searching the message, in which case the decoder circuit may 
direct the barrel shifter to input a new message portion to the CAM. The actions or 
instructions may alternatively direct the decoder to send the message to, e.g., a particular 
interface or port for forwarding or to a central processing unit (CPU) for additional 

15 processing. Other actions or instructions may cause the decoder to increment a counter, 
call and apply a particular subroutine, copy information regarding the message into a 
third memory device, etc. The programmable pattern matching engine of the present 
invention, including the CAM and its associated RAM, is preferably implemented 
through one or more integrated hardware components that efficiently interoperate so as to 

20 process network messages at high rates of speed, including multi-gigabit per second 
transmission rates. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention description below refers to the accompanying drawings, of which: 
Fig. 1 is a highly schematic block diagram of a computer network; 
Fig. 2 is a partial functional block diagram of an intermediate network device 
5 including a pattern matching engine in accordance with the present invention; 

Fig. 3 is a highly schematic block diagram of the pattern matching engine of Fig. 

2; 

Figs. 4 and 5 are representative data structures for use with the pattern matching 
engine of the present invention; and 
10 Figs. 6 and 7 are highly schematic, partial representations of the memory 

structures of the pattern matching engine. 

DETAILED DESCRIPTION OF AN ILLUSTRATIVE 

EMBODIMENT 

Fig. 1 is a highly schematic block diagram of a computer network 100 comprising 
15 a plurality of stations that are attached to and thus interconnected by a network of 

communications media. The stations are typically computers, which may include hosts 
102-106 (H1-H3), servers 108-1 12, and intermediate network devices, such as switches 
S1-S5. Hosts H1-H3 may be personal computers or workstations. Each station of 
network 100 typically comprises a plurality of interconnected elements including a 
20 processor, a memory and a network adapter. The memory, moreover, may comprise 
storage locations addressable by the processor and the network adapter for storing 
software programs and data structures. The processor may comprise processing elements 
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or logic for executing the software programs and manipulating the data structures. An 
operating system, typically resident in memory and executed by the processor, 
functionally organizes the station by invoking network operations in support of software 
processes executing on the station. 
5 The communications media of network 1 00 preferably include one or more local 

area networks (LANs), such as LAN 1 14 to which hosts H1-H3 are attached, and LAN 
1 16 to which servers 108-1 12 are attached. LANs 1 14 and 1 16 preferably support 
communication between attached stations by means of a LAN standard, such as the 
Token Ring or Ethernet LAN standards, which are defined by the Institute of Electrical 
10 and Electronics Engineers (IEEE) at IEEE standards 802.3 and 802.5, respectively. 

Switches S1-S5 are preferably interconnected by a series of point-to-point links 
1 18a-e and arranged as a network cloud 120, which interconnects the hosts H1-H3 on 
LAN 1 14 with the servers 108-1 12 on LAN 116. More specifically, switch SI is attached 
to LAN 1 14 and switch S3 is attached to LAN 1 16. Thus, outside access to LAN 116, 
15 which may be considered a private network, must pass through one or more switches Sl- 
S5 of network cloud 120. Servers 108-1 12 on LAN 1 16 are preferably configured to 
provide one or more services. For example, servers 108 and 1 10 may be configured as 
web-hosting servers, while server 112 may be configured as an electronic mail or 
database server. 

20 Communication among the stations of network 1 00 is typically effected by 

generating and exchanging network messages between the communicating stations. That 
is, a source station may generate one or more discrete packets or segments in accordance 
with the higher layer protocols of a communications stack and encapsulate those packets 
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or segments in one or more data frames whose format is defined by the LAN standard for 
the particular communications media to which the source station is attached. 

In the preferred embodiment, these higher layer protocols correspond to the well- 
known Transmission Control Protocol/Internet Protocol (TCP/IP) Reference Model 
5 which is described in A. Tanenbaum Computer Networks (3rd ed. 1996) at pp. 35-38, 
among other places. Those skilled in the art will recognize that the present invention may 
work advantageously with other types of communication standards, such as the Internet 
Packet Exchange (IPX) protocol, etc. 

A network manager responsible for servers 108-112 may wish to identify the 
10 particular types of traffic attempting to contact and obtain services from these servers so 
that appropriate treatments may be applied to that traffic. For example, the network 
administrator may wish to block outside access to certain web sites and/or web pages 
hosted by web server 108. Alternatively, the network manager may wish to identify 
attempts to contact specific web pages at servers 108 and 1 10 (e.g., electronic commerce 
15 pages) so that this traffic may receive higher priority within network cloud 120. The 
identity of such web pages may be specified by the particular uniform resource locators 
(URLs) contained in the network messages sent to web servers 108 and 1 10. Similarly, 
the network manager may wish to identify the particular application attempting to contact 
or connect to database server 1 12 so that traffic corresponding to mission-critical 
20 applications (e.g., processing customer invoices) can be given higher priority, while less 
important applications (e.g., bulk file transfers) can be given lower priority. 

As described above, identifying such traffic flows was conventionally performed 
in software by servers or, in limited circumstances, by network devices. That is, a pattern 

10 
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matching software program would be written, typically in the Perl programming 
language, to search for a desired regular expression. Network messages received by an 
intermediate network device, such as a switch, would be passed to the processor which 
would execute the software program. The processor and memory architectures employed 
5 by most network devices often required that the network messages be evaluated one byte 
at a time. With the increases in transmission speeds through gigabit Ethernet and other 
high-speed communication standards and the longer network layer station addresses 
defined by IP version 6 (IPv6), software solutions for parsing network messages are 
becoming less efficient. As described below, the present invention is directed to a 
10 programmable pattern matching engine, preferably implemented as a logic circuit, that is 
designed to parse the contents of network messages for pre-defined regular expressions 
and to execute corresponding actions on those messages at high speeds, e.g., at multi- 
gigabit per second rates. 

Fig. 2 is a schematic, partial block diagram of switch SI, designated generally as 
15 switch 200. The switch SI is preferably configured as a layer 4/7 switch having a 

software routing component and hardware components distributed among a plurality of 
line cards (LCO-3) that are interconnected by a switch fabric 220. One of the line cards, 
denoted LC0, is a switch management card (SMC) that includes an internal router (R) of 
the switch. The internal router may be embodied as a routing process executing in the 
20 internetwork layer (layer 3) or transport layer (layer 4) of a conventional protocol stack. 

Each line card comprises a plurality of ports P (e.g., P0-P2), a local target logic 
(LTL) memory and an up/down link (UDlink) interface circuit interconnected by a local 
bus 210. Each line card further contains a microprocessor (up) in communicating 
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relation with all of its "peer" microprocessors in switch 200 over a management bus (not 
shown). Some of the line cards may comprise self-contained "mini-switches" that are 
capable of rendering forwarding decision operations for data frame traffic switched by 
the fabric 320; that is, forwarding decisions implemented by the switch fabric may be 
5 provided by some line cards. Each of these cards includes an encoded address 

recognition logic (EARL) circuit coupled to the UDlink and microprocessor. The EARL 
executes all forwarding decisions for its associated line card(s), while the LTL 
implements those forwarding decisions by selecting ports as destinations for receiving 
data (in the form of frames or packets) transferred over the local bus. To that end, the 
10 EARL contains forwarding engine circuitry (FE) and at least one forwarding table 
(FwdT) configured to produce a unique destination port index value. 

The switch fabric 220 is preferably a switching matrix employed to control the 
transfer of data among the line cards of the switch 200. The UDlink provides an interface 
between the local bus 210 on each line card and the switch fabric 220. Inputs to the LTL 
15 logic are received over the local bus 210, which is driven by the UDlink. By employing 
the UDlink in this manner, a line card (e.g., LCO-2) may include both an EARL circuit 
and a UDlink or it may share the EARL contained on another line card. In this latter 
case, a common bus 230 enables a line card without a forwarding engine (e.g., LC3) to 
use the forwarding engine (e.g., EARL 0) on another line card, such as the SMC. For 
20 those line cards without a forwarding engine, the UDlink also provides a connection to 
the common bus 230. 

The format of data between each line card and the switch fabric is generally 
similar to that employed over the local bus. For example, the format of data transferred 
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from each line card to the switch fabric (hereinafter referred to as a "fabric frame") 
includes bit mask information instructing the switch fabric 220 where to forward the 
frame and other information, such as cost of service (COS) information, used by the 
switch. This information, which is also included on fabric frames traversing the local bus 
5 20, is embedded within a header of each frame. 

Suitable intermediate network device platforms for use with the present invention 
include the commercially available Catalyst 5000 and 6000 series of switches from Cisco 
Systems, Inc., along with the intermediate network device disclosed in copending and 
commonly assigned U.S. Patent Application Serial No. 09/469,062 titled, Method and 
10 Apparatus for Updating and Synchronizing Forwarding Tables in a Distributed Network 
Switch by Thomas J. Edsall et al. 

The layer 4/7 switch SI (200) preferably functions as a border gateway to private 
LAN 1 16 (Fig. 1). In addition, switch SI may function as a firewall and a load balancer 
that analyzes higher layer headers (e.g., layer 4 header) and data (e.g., layer 7 application 
15 data) of network messages received at the switch 200. In the former case, a firewall 
engine of switch SI analyzes the network messages to counter attacks by potential 
intruders/hackers, whereas in the latter case, a load balancer function analyzes the 
messages to identify one or more regular expression, and to direct matching messages to 
an appropriate server 108-1 12. Typically, a switch that is configured to perform such 
20 higher layer functions implements the regular expression matching processing in 
software, such as one or more software modules or libraries written in the Perl 
programming language. As described above, however, such software-based processing 
can be inefficient and may result in a bottleneck within the switch. The present invention 
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provides a fast packet parsing and pattern matching engine for use in an intermediate 
network device, such as switch SI, to efficiently perform packet analysis and flow 
treatment functions. In particular, the engine can parse extension headers (e.g., Ipv6 
extension headers) and textual messages (e.g., HTML headers), rapidly match regular 
expressions, and pass relevant fields (e.g., URLs) to other switch components. 

To these ends, the common bus 230 of switch 200 further enables the line cards 
LC0-LC3 to interact with a high-speed message processing card 250 by exchanging data 
over the bus 230. Message processing card 250 preferably includes, inter alia, a data 
management engine 252, an IP re-assembly engine 254, a traffic shaper 256, a packet 
buffer 258, and a pattern matching engine 260. The traffic shaper 256, IP re-assembly 
engine 254, packet buffer 258 and pattern matching engine 260 are each coupled to the 
data management engine 252, and control information may be exchanged with engine 
260 and the other components of switch 200 through a plurality of predefined type- 
length-value (TLV) messages. 

Fig. 3 is a highly schematic block diagram of the pattern matching engine 260 of 
switch 200 (SI) of Fig. 2. The pattern matching engine 260 preferably includes a 
decoder circuit 302 for decoding and executing message-related instructions, and a 
regular expression storage device 324 having a content-addressable memory (CAM) 304 
that can be programmed, as described below, to store at least the regular expression 
patterns used in searching network messages. The pattern matching engine 260 further 
includes a message buffer 306 for storing a network message to be evaluated, and a barrel 
shifter 308 that is connected to the message buffer 306 and operatively controlled by the 
decoder circuit 302 as illustrated by control arrow 312. The barrel shifter 308 is 
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configured to reveal a selected segment or portion of the message stored in buffer 306 as 
directed by the decoder circuit 302. Decoder circuit 302 essentially "slides" the barrel 
shifter 306 along the message buffer 306 as illustrated by double arrow 313 so as to 
reveal the selected window. The barrel shifter 308 is further coupled to the CAM 304 so 
5 as to load the retrieved message portion into a message space 3 1 0 of a CAM input 3 14 
that, in turn, is inputted to the CAM 304 as indicated by arrow 316. The CAM input 314 
further includes a tag space 318 that is loaded with a tag valve as described below by the 
decoder circuit 302. 

In the illustrative embodiment, the regular expression storage device 324 further 
10 includes a second memory structure or device 320, such as a random access memory 
(RAM), that is associated with CAM 304 and programmed, as described below, to 
contain the actions or treatments that are to be applied to network messages matching the 
regular expressions contained within the CAM 304. In particular, both the CAM 304 and 
the RAM 320 include a plurality of respective entries or rows. Each entry or row of the 
15 CAM 304, moreover, includes a pointer that particularly identifies a corresponding entry 
(i.e., a location) of the RAM 320 as indicated by arrow 322. That is, there is a one-to-one 
correspondence between CAM entries and RAM entries. The RAM 320, moreover, is 
configured to provide an output (i.e., the contents of the row or entry identified by the 
matching CAM entry) to the decoder circuit 302 as indicated by arrow 326. The 
20 combination of the CAM 304 and RAM 320 forms the preferred high-speed regular 

expression storage device 324 of the present invention. To improve performance, pattern 
matching engine 260 preferably includes multiple (e.g., ten) instances of decoder circuits, 
message buffers, etc. each processing a different message and each configured to submit 
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inputs to and receive outputs from the CAM 304 and RAM 320. This arrangement 
allows messages to be processed in pipeline fashion reducing overall message processing 
time. 

The decoder circuit 302 may be further coupled and thus have access to a 
5 subroutine stack 328, a counter memory 330 and a message field memory 3 32. 

Depending on the action identified by the output from RAM 320, the decoder circuit 302 
may interoperate with and thus utilize the facilities offered by one or more of the 
subroutine stack 328, the counter memory 330 and the message field memory 332. 
Engine 260 may also include a pre-parser 334 which receives as an input the network 
10 message from packet buffer 25 8 (Fig. 2) as indicated by arrow 336. The pre-parser 334 is 
preferably a logic circuit that is configured and arranged to extract one or more 
commonly evaluated fields from the network message in order to speed up the operations 
of the pattern matching engine 260. The pre-parser 334 preferably prepends these 
extracted fields to the network message and passes the combination (i.e., network 
15 message and appended fields) to the message buffer 306 for storage therein as indicated 
by arrow 338. 

The CAM 304 is preferably a ternary content addressable memory (TCAM) so 
that the cells (not shown) of each entry or row may be associated with or assigned one 
of three possible values, "0", "1" or "don't care". A preferred TCAM has 512K rows 
20 of 288 bit length each. To implement the "don't care" value, the TCAM 406 may be 
segregated into blocks of cells (each cell being either asserted or de-asserted) and a 
corresponding mask applied to determine whether the particular cells of its block are 
"care" or "don't care". The TCAM 406 and RAM 320 may be static or dynamic. 

16 

H:\U2\025\0174\PROSECUT\0174.DOC 03/22/00 4:50 PM 



PATENT 
112025-0174 

Those skilled in the art will recognize that other combinations of hardware 
components in addition to those specifically described herein may be advantageously 
utilized to achieve the objectives of the present invention. For example, if TCAMs of 
sufficient width were reasonably or commercially available, then the associated RAM 
320 might be rendered unnecessary. That is, a sufficiently wide TCAM could store 
both the regular expressions and the corresponding actions or treatments. In that case, 
the regular expression storage device 324 would simply comprise one or more large 
TCAMs whose output (i.e., the matching action) would be provided directly to the 

decoder circuit 302. 

The pattern matching engine 260 is preferably formed from one or more 
Application Specific Integrated Circuits (ASICs) or Field Programmable Gate Arrays 
(FPGAs). Suitable TCAMs for use with the present invention are commercially 
available from NetLogic Microsystems, Inc. of Mountain View, California and Music 
Semiconductors of Hackettstown, New Jersey. RAM 320 may be programmed through 
one or more conventional write operations, while the TCAM 304 may be programmed 
through a dedicated port (e.g., a Parallel Input/Output port) (not shown). It should be 
understood that some high-level software may be utilized to generate the data or 
information used to program the TCAM 304 and RAM 320. 

Operation of the pattern matching engine 260 of the present invention preferably 

proceeds as follows. Suppose host HI (Fig. 1) at LAN 1 14 generates one or more 

network messages for contacting a website hosted at server 108 at LAN 116. The 

network communications facilities at host HI encapsulates the network message into one 

or more TCP segments and passes it down the communications stack for transmission on 
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LAN 1 14. In particular the TCP segment is encapsulated into one or more IP packets and 
the IP packets, in turn, are encapsulated into one or more Ethernet frames which may be 
driven onto LAN 1 14 by host HI. Assuming port P2 (Fig. 2) of line card LC3 is attached 
to LAN 1 14, then these frames are received at LC3. LC3 transfers the frames to its 
5 UDLINK 3 via local bus 210 in a conventional manner, and the UDLINK 3 drives them 
onto common bus 230. The frames are received at the other line cards (i.e., LC0-LC2) 
and also at the message processing card 250. Assuming forwarding engine FE 1 at line 
card LCI concludes that the frames should be processed by the message processing card 
rt 250, the line cards LC0-LC2 simply discard them. At the message processing card 250, 

! j 10 the frames are handed to the IP re-assembly engine 254 which, in turn, recovers the 
§j corresponding network message (i.e., the IP packet and/or the TCP segment) from the 

p plurality of Ethernet frames and stores the message in the packet buffer 258. 

^ The pattern matching engine 260 retrieves the network message from the packet 

ffi buffer 258 and provides it to pre-parser 334 (Fig. 3) via arrow 336. The pre-parser 334 

Pi 15 scans the message and pulls out commonly evaluated fields. For example, the pre-parser 
334 may pull out the following information: IP source address, IP destination address, 
TCP/UDP source port, TCP/UDP destination port, transport layer protocol type (typically 
TCP or UDP), IP type of service (TOS), virtual LAN (VLAN) identifier (to the extent the 
message is associated with a VLAN), TCP acknowledgement (ACK) flag, TCP 
20 synchronize (SYN) flag, TCP end-of-transmission (FIN) flag, TCP reset (RST) flag, an 
index to the port at which the message was received (e.g., port P2 of line card LC3), 
TCP/UDP padding (if any), and the underlying layer 2 (i.e., Ethernet) frame. 
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This information (i.e., the commonly evaluated fields and the layer 2 frame) are 
then stored in the message buffer 306 by the pre-parser 334 via arrow 338. The contents 
of the message buffer 306 then undergo one or more look-ups into the CAM 304 under 
the control of the decoder circuit 302. Specifically, the decoder circuit 302 directs the 

5 barrel shifter 308 to reveal and load a selected segment or portion of the contents of the 
message buffer 306 and place it in the message portion space 3 10 of CAM input 314. In 
the illustrated embodiment, the barrel shifter 308 is configured to reveal and load 32 byte 
segments and to slide along the message buffer in 1 byte increments. The decoder circuit 
302 selects the desired 32 byte segment from message buffer 306 by providing the barrel 

10 shifter 308 with an offset value via command line 3 12. An offset of 0, for example, 
results in bytes 0-31 being loaded into message portion space 310 of CAM input 314, 
whereas an offset of "1" results in bytes 1-32 being loaded and an offset of "2" would 
result in bytes 2-33 being loaded, etc. 

Initially, the decoder circuit 302 provides an offset of 0 to the barrel shifter 308 

15 resulting in bytes 0-3 1 from the message buffer 306 being loaded into the message 
portion space 3 10 of CAM input 3 14. The decoder circuit 302 is also programmed to 
load an initial tag value into the tag space 3 1 8 of CAM input 314. 

For TCP/IP traffic, all TCP/UDP segments corresponding to the same stream, as 
identified by the contents of their Ethernet and IP headers, are passed to the pattern 

20 matching engine 260 for parsing. When the end of the current segment being evaluated is 
reached, the pattern matching engine 260 preferably saves the current state so that it may 
be reloaded when the next segment is received. 



19 

H:\l 12\025\0174VPROSECUT\0174.DOC 03/22/00 4:50 PM 



PATENT 
112025-0174 

Fig. 4 is a block diagram of the CAM input 314, which generally includes a tag 
space 318 and a message data space 310. The tag space 318 includes a tag field 402 that 
contains the tag value used by the decoder circuit 302 in selecting a desired "logical" 
CAM within CAM 304, thereby extending the capabilities and improving the 
5 performance of the pattern matching engine 260. The tag space 3 1 8 also includes other 
fields that are similarly loaded by the decoder circuit 302. In particular, the tag space 318 
includes an end (E) flag 404 that is asserted by the decoder circuit 302 when the message 
space 310 contains the last 32 byte section of information from the message buffer 306, 
otherwise the decoder circuit 302 leaves the E flag 404 de-asserted. A valid field 406 
10 indicates the number of bytes in the message space 310 that are valid. A reserved (RES.) 
field 408 is presently unused. 

Once the CAM input 314 is loaded, it is provided to the CAM 304 as indicated by 
arrow 316. CAM 304, in a conventional manner, compares the CAM input 314 with each 
of its entries all at the same time and identifies the first entry matching the input 314. As 
15 described above, each entry of the CAM 304 identifies and thus corresponds to an 
associated entry in RAM 320 that contains the action or treatment to be applied to the 
message matching the respective CAM entry. Thus, assuming there is a matching entry 
for this CAM input 3 14, the matching entry identifies a corresponding location in RAM 
320 as indicated by arrow 322. In response, RAM 320 provides the contents of this 
20 location to the decoder circuit 302 as indicated by arrow 326. 

Fig. 5 is a block diagram of the preferred format of an output 500 from RAM 320 
(Fig. 3), e.g., the identified row or entry of the RAM 320 as provided to the decoder 
circuit 302. RAM output 500 has two parts; a first part 502 that pertains to the current 
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TCAM look-up, and a second part 504 that pertains to the next TCAM look-up, if any. 
The first part 502 preferably includes a one-bit done (D) flag 506, which indicates that 
the message being evaluated requires no further processing by engine 260, a six-bit 
operation code (op code) field 508 that specifies the particular action to be taken or the 
treatment to be applied to this message, a six-bit valid byte (VB) field 510, a one-bit end 
check (EC) field 512, and a 65-bit instruction-specific data area 514 that contains data for 
executing the action or treatment specified by the op code of field 508. The second part 
504 may similarly be configured to have a plurality of fields. For example, second area 
504 may include an eight-bit off-set field 516 and an associated one-bit relative (R) flag 
518, which the decoder circuit 302 uses to slide the barrel shifter 308 along the message 
buffer 306 and thus input a new portion of the message to the TCAM 304. Second area 
504 may further include a tag field 520, which itself may be divided into a presently un- 
used one-bit flag (F) field 522, a second one-bit relative (R) flag 524 that is associated 
with an eighteen-bit tag value field 526. 

It should be understood that areas 502 and 504 may include additional or other 
fields. For example, the second area 504 may also include a look-up source field, which 
may be used to designate some other source besides the message buffer 306 for the next 
TCAM look-up. Other such sources may include control (e.g., TLV) information, other, 
non-message related, data received by the engine 260 or output data from the RAM 320. 

Those skilled in the art will recognize that various op codes may be defined in 
order to carry out any number of desired actions or treatments. In the preferred 
embodiment, the following op codes are defined and utilized. 
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CONT 

A first action is to continue searching the current message stored at message 
buffer 306. Here, the done flag 506 is de-asserted, indicating that the decoder circuit 302 
is to continue processing the message, and the op code 508 is set to a pre-selected value 
5 (e.g., "0") which the decoder circuit 302 is programmed to recognize as the continue 
action. The offset field 516 contains the specific offset (e.g., in bytes) that the decoder 
circuit 302 is to employ in sliding the barrel 308 shifter along the message buffer 306 so 
as to retrieve the next message segment. The first R flag 518 indicates whether the offset 
from field 516 is relative (e.g., the flag is asserted) or absolute (e.g., the flag is de- 
10 asserted). A relative offset means that the decoder circuit 302 simply slides the barrel 
shifter 308 from its current position by whatever value is contained in the offset field 516 
(e.g., 3 bytes). An absolute offset is independent of the barrel shifter's current position 
end means that the decoder circuit 302 is to slide the barrel shifter 308 along buffer 306 
so that it is located a specific distance into the message. For example, if the first R flag 
15 518 were de-asserted and the associated offset field 516 contained the value "3", then the 
decoder circuit 302 would move the barrel shifter 308 so that the respective window 
defined by barrel shifter 308 started at the third byte of the message within buffer 306. 

For a continue action, the tag value field 526 preferably contains the tag to be 
inserted in the tag space 318 of the next CAM input 314 by the decoder circuit 302. If 
20 the second R flag 524 is asserted (relative mode), then the decoder circuit 302 adds the 
value contained in the tag value field 526 to the tag value of the previous CAM input 314 
in order to obtain a new tag for the next CAM input 314. If the second R flag is de- 
asserted (absolute mode), then decoder circuit 302 simply copies the contents of the tag 



22 

H:\l 12\025\0174\PROSECUT\0174.DOC 03/22/00 4:50 PM 



PATENT 
112025-0174 

value 526 into to the tag space 318 of the next CAM input 314. In sum, the continue 
action, directs the decoder circuit 302 to formulate a new CAM input 314 with a new 
message segment and possibly a new tag. The continue action is typically used when a 
long regular expression is broken up into multiple CAM entries (e.g., searching for IPv6 
addresses). 

SEND 

Engine 260 supports one or more send actions for use in forwarding matching 
messages. A send action may be used upon matching the last portion of an IPv6 address 
in order to send the respective message to a particular interface or port for forwarding. In 
the preferred embodiment, there are two types of send actions: a network (NTWK) send 
and a CPU send. A network send means the message is sent to a given port or interface 
for forwarding. A CPU send means the message is sent to a processor for additional 
processing. The particular CPU may be a main CPU (not shown) at the switch 200 or it 
may be one of the microprocessors (up) at a particular line card LC0-LC3. 

For a NTWK send, the done flag 506 is asserted indicating that engine 260 is 
done processing the message, and the op code 508 is set to a pre-selected value (e.g., "1") 
which the decoder circuit 302 is programmed to recognize as a NTWK send action. The 
instruction-specific information area 514 includes a re-write pointer sub-field and a 
shaper identifier (SID) sub-field. The re-write pointer identifies a particular re-write rule 
that may be used by the respective EARL in re-writing the message before it is 
forwarded. The re-write rule, for example, may direct the EARL to re-write the message 
so as to be compatible with a different layer 2 standard (e.g., Token Ring). The pattern 
matching engine 260 preferably forwards the message along with the specified re-write 
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rule to the appropriate EARL for implementing the network send action. The message is 
also shaped by traffic shaper in accordance with the returned SID. 

For a CPU send, the done flag 506 is similarly asserted. The op code 508 is set to 
another pre-selected value (e.g., "2") which the decoder circuit 302 recognizes as a CPU 
send action. The instruction-specific information area 514 includes a program pointer 
sub-field which identifies a program or process located in the CPU's associated memory. 
The message and program identifier are then forwarded to the CPU, which executes the 
identified program and takes the resulting action. A CPU send action may be used, for 
example, to perform stateful inspections of messages that have been identified by engine 
260 as belonging to the H.225 protocol. The H.225 protocol governs the control session 
for setting up a real-time multimedia session in a packet-based network in accordance 
with the well-known H.323 protocol from the International Telecommunications Union 
(ITU). The CPU may process the message and learn the parameters (e.g., TCP source 
and destination ports, etc.) of the up-coming multimedia session, and, in response, insert 
new entries in the CAM 304 in order to match the subsequent H.323 messages. 

CNT 

A counter action is used to increment one or more counters maintained at the 
counter memory 330 (Fig. 3). Here, the D flag 506 may be asserted or de-asserted 
depending on whether or not additional processing will take place, and the op code 508 
may be set to "3". The instruction-specific information space 514 includes a counter 
number sub-field and a value sub-field. The counter number identifies a particular 
counter within counter memory 330 and the value specifies the amount by which the 
identified counter should be incremented (or decremented). The decoder circuit 302 
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preferably uses a pre-defined command or action to carry out the counter action. The 
counter action (CNT) is typically used to record traffic flow statistics. For example, 
counters may be established and up-dated to record the amount of traffic accesses the 
various services provided by servers 108-1 12 (Fig. 1). 

5 If the D flag of the CNT action is de-asserted, then the decoder circuit 302 also 

causes a new CAM input 314 to be generated by directing the barrel shifter 308 to load a 
new message segment into message space 310 in accordance with the values in the first R 
flag 518 and offset field 516. The decoder circuit 302 loads a new value into the tag 
space 318 of this new CAM input 314 as specified by the values in the second R flag 524 

10 and the tag value field 526 of the CNT action. 
CALL 

A call action, in combination with a return (RET) action, as described below, is 
used by engine 260 to implement a particular subroutine. Subroutines are preferably used 
to perform pattern matching tasks that are repeatedly encountered, such as skipping over 

15 white or blank spaces in messages, skipping over "//" in URLs, etc. For example, upon 
matching some preliminary regular expression, it may be that the following portion of the 
message, which may be of variable length, contains white spaces or blanks. In order to 
skip over these white spaces or blanks and resume searching on the next piece of data 
within the message, engine 260 uses a subroutine. First, upon matching the portion of the 

20 message at which the white spaces or blank portion begins, the corresponding action 
returned by RAM 320 is a CALL. The CALL action has the D flag is de-asserted 
indicating that processing of the respective message is not yet complete. The op code 
may be set to "4" to reflect a CALL action. The instruction-specific information space 
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514 preferably contains a return tag field, that specifies the tag to be used by the decoder 
circuit 302 after executing the desired subroutine, and a subroutine tag field that specifies 
the logical CAM within CAM 304 that has been configured to execute the selected 
subroutine (e.g., skipping over blank spaces). The return tag is preferably pushed onto 
the subroutine stack 328 by the decoder circuit 302, and the subroutine tag is used by the 
decoder circuit 302 to load the tag space 3 1 8 of the next CAM input 3 14. The decoder 
circuit 302 similarly utilizes the offset 516 of the CALL action to direct the barrel shifter 
308 to retrieve the appropriate segment (i.e., window) of the message and load it into the 
message space 310 of the next CAM input 314. The corresponding entries of the selected 
logical CAM are programmed to execute the desired subroutine (e.g., skip over the white 
spaces or blanks). It should be understood that while the pattern matching engine 260 is 
working through the subroutine, one or more CONT actions may be executed (i.e., the 
subroutine itself may include one or more CONT instructions). The action specified by 
the last matching CAM entry for the subroutine is preferably a return (RET) action. 
RET 

With the RET action, the D flag is preferably de-asserted indicating that 
processing of the respective message is not yet complete. The op code may be set to "5" 
to reflect a RET action. In response to the RET action, the decoder circuit 302 "pops" the 
return tag value from the top of the subroutine stack memory 328. The decoder circuit 
302 then uses this return tag, along with the offset 516 specified in the RET action to 
generate a new CAM input 314 so as to continue processing the message. For example, 
after locating last white space, the RET action may contain a value in the offset field 516 
that identifies where in the message data resumes. The decoder circuit 302 can then use 
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this offset to slide the barrel shifter 308 directly to this point and resume searching from 
that point forward. 
MARK 

A mark action is typically used in combination with a memory copy action to 

5 store particular locations in a message at which significant data is found. The mark 
action preferably has the D flag 506 de-asserted, has an op code of "6" and includes an 
offset adjustment sub-field within the instruction-specific information space 514. The 
offset adjustment sub-field is used to identify the position to be marked, which may be 
different from the regular expression being searched. In response to the mark action, the 

10 decoder circuit 302 preferably adds the value contained in the offset adjustment sub-field 
to the current offset value (i.e., the offset used to place the barrel shifter 308 in its current 
position) and stores the result in an internal register (not shown). This internal register is 
then typically read in response to a memory copy action, described below, in order to 
copy a section of the message from the marked position to the position that is matched by 

15 the memory copy action. 

Since the D flag 506 is not asserted, the decoder circuit 302 also continues 
searching the message. That is, decoder circuit 302 formulates a new CAM input 3 14 by 
directing the barrel shifter 308 to load a new message segment into message space 310 in 
accordance with the values in the first R flag 518 and offset field 516 of the MARK 

20 action, and loads a new value into the tag space 3 1 8 in accordance with the values in the 
second R flag 524 and the tag value field 526 of the MARK action. 
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MEMCPY 

A memory copy (MEMCPY) action is preferably used to store a field descriptor 
in the message field memory 332. The MEMCPY action preferably has the D flag 506 
de-asserted, has an op code of "7" and includes sub-fields for offset adjustment, field 
name and descriptor index within the instruction-specific information space 514. In 
response to the MEMCPY action, the decoder circuit 302 preferably enters an array in the 
message field memory 332. The decoder circuit 302 preferably copies the value from its 
internal register (generated in response to the MARK action as described above) into the 
array, which represents a start field pointer. It also adds the offset adjustment contained 
in the MEMCPY action to the current offset and stores this result in the array as well, 
which represents an end field pointer. Decoder circuit 302 also stores the field name and 
descriptor index as specified by the MEMCPY action in the array. The decoder circuit 
302 may also generate a length for the array and similarly store this value. 
OFS 

An offset (OFS) action is used by the decoder circuit 302 to skip over segments of 
the message that have variable lengths (e.g., the options areas of IP packets and/or 
TCP/UDP segments). Basically, the decoder circuit 302 uses information contained with 
the OFS action to compute a new offset for directing the barrel shifter 308 to a new 
location along the message buffer 306. The OFS action preferably has the D flag 506 de- 
asserted, an op code of "8" and an offset position (OP) field in place of the offset field 
516. Within the instruction-specific information space 514, the OFS action includes sub- 
fields for offset length (OL), offset granularity (OG) and an offset constant (OC). The 
decoder circuit 302 computes the new offset from this information as follows. The OL 
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sub-field specifies the length of the OP field (e.g., 4, 8, 16 or 32 bits). The value of the 
OP field may be specified in units of bytes, 16-bit words, 32-bit words or 64-bit words. 
The OG sub-field converts the value from the OP field into bits. The OC is used to 
account for situations in which the variable length field does not immediately follows the 
5 offset field. Thus, the offset is computed by the decoder circuit 302 as follows: 
OP * OG + OC 
Other Actions 

It should be understood that additional or other actions may be defined and stored 
within the RAM 320. For example, an action that un-binds a TCP session (UBND) could 

10 be defined. In response to this action, the decoder circuit 302 would direct the CPU or 
other component responsible for the subject TCP session to break it. Alternatively, an 
action for populating the fields of a traffic flow table (FTBL) could be defined and stored 
within RAM 320. In response to the FTBL action, the decoder circuit 302 might specify 
a particular treatment to be applied to a given traffic flow and cause that treatment to be 

15 stored in a table, thereby avoiding the need to process future messages corresponding to 
this flow in the pattern matching engine 260. 

Other possible actions include a generate TLV action, which causes the engine 
260 to generate a particular TLV message for some other switch component. A compare 
action causes the decoder circuit 302 to perform some comparison (e.g., a comparison 

20 against a value in a specified register). 

The VB and EC fields 510, 512 of the RAM output 500 (Fig. 5) are preferably 
used to perform efficient, partial look-ups within TCAM 304, and to correctly identify 
the end of strings. For example, the value of the VB is preferably set to the minimum 
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number of valid bytes (i.e., not padding) inserted into the message data portion 310 of the 
current TCAM input 3 14 or look-up in order to treat a match as a "true" hit. For 
example, if the message data portion 310 of the current TCAM look-up contains 22 bytes 
of valid data (the rest being padding) and the number of valid bytes from the VB field 
5 5 1 0 of the matching RAM output 500 is 20, then decoder circuit 302 knows it has a 

"true" hit and proceeds to execute the action specified by the corresponding op code from 
field 508. If the number of valid bytes of the current TCAM input 314 or look-up was 
less than 22 bytes, then the decoder circuit 302 looks to see if the EC field 512 is 
asserted. If the EC bit is not asserted, the decoder circuit 302 simply saves the values 
10 from the offset 516, relative 518 and tag 520 fields and waits to receive additional data 
(e.g., another TCP/UDP segment). When the new data (e.g., segment) is received, the 
decoder circuit 302 retrieves the offset, relative and tag values and uses them to generate 
the next TCAM input 314. 

If the number of valid bytes of the current TCAM input 314 is less than the value 
15 specified in the VB field 510 and the EC field 512 is asserted, then the decoder circuit 
302 first saves the tag and offset from the current TCAM input 3 14 as well as the new op 
code, tag and offset from the RAM output 500. It then performs another look-up in the 
TCAM 304 using the same data from the message data portion 310 of the current TCAM 
look-up, but using a new subroutine tag in order to search the contents of the message 
20 data portion 3 1 0 for an end delimiter. The particular subroutine tag may be specified in a 
separate field, e.g., a subroutine tag index (STI) field (not shown), in the RAM output 
500. If a match is found (i.e., the end delimiter is located), a return (RET) action is 
preferably specified in the op code field 508 of the matching RAM output 500. In 
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response to the RET action, the decoder circuit 302 retrieves the previously stored op 
code, tag and offset values from the prior RAM output 500 and executes the action 
specified by that op code. If a match is not found, then the decoder circuit 302 simply 
waits for the receipt of more data (e.g., another TCP/UDP segment) and uses the 

5 previously saved offset, relative and tag values from the last RAM output 500 in order to 
generate the next TCAM input 314. 

As shown, the pattern matching engine 260 of the present invention can parse 
network messages at high speeds (e.g., multi-Gigabit rates). By selectively programming 
the CAM entries of the storage device 324, engine 260 can search for regular expressions 

10 occurring anywhere within the selected network messages, including both the header 
(e.g., TCP, IP, and/or data link headers) and the payload (e.g., the data portion) and take 
responsive actions. A switch incorporating the pattern matching engine 260 can thus 
make forwarding decisions based on selected parameters or criteria from layer 2 (i.e., the 
data link layer) through layer 7 (i.e., the application layer). 

15 A pattern matching example 

Suppose that a network administrator wishes to identify network messages that 
begin with the string "123456" and to re-write and forward such messages in accordance 
with some pre-defined re-write rule (e.g., rule 35). Suppose further that the network 
administrator also wishes to identify messages having a "55" before a "65" anywhere 

20 within the message, and to execute some pre-defined software routine (e.g., program 
number 2) on such messages. Finally, for all messages which do not satisfy either of 
these two requirements, suppose that the network manager wishes to execute another pre- 
defined software routine (e.g., program number 1) on such messages. 
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Fig. 6 is a highly schematic representation of CAM 304 and RAM 320 whose 
entries have been programmed to carry out the above-defined actions. Both CAM 304 
and RAM 320 have a plurality of corresponding entries or rows which are organized into 
a plurality of fields by means of a number of common columns. CAM 304, for example, 

5 includes an end column 602 for matching against the end flag 404 (Fig. 4) of CAM inputs 
314, a tag column 604 for matching against the tag field 402 of CAM inputs 3 14 and a 
series of data columns 606-612 for matching against the information contained in the 
message data space 310 of CAM inputs 314. RAM 320 similarly includes a tag column 
614 for storing the tag portion 520 of RAM outputs 500, an offset column 616 for storing 

10 the offsets 516 of RAM outputs 500, an op code column 618 for storing the op codes 508 
of RAM outputs 500, a done column 620 for storing the done flag 506 of RAM outputs 
500, and a column 622 for storing the instruction -specific information of RAM outputs 
500. By virtue of the values stored in the entries of the tag column 604 (i.e., 0-2, and "X" 
for don't care), CAM 304, which is a ternary content addressable memory, may be 

15 considered to include four "logical" CAMs 624-630. 

When a message is first received and stored in message buffer 306 (Fig. 3), the 
decoder circuit 302 preferably provides the barrel shifter 308 with an offset of "0", 
thereby causing the barrel shifter 308 to load the first M bytes of the message into 
message space 310 of CAM input 314, where M corresponds to the width or window of 

20 the barrel shifter 308. The decoder circuit 302 also loads an initial value (e.g., "0") into 
the tag space 3 1 8 of the CAM input 3 14 and applies this input to CAM 304. Only the 
first logical CAM 624 has tag values of "0", however, and thus this CAM input can only 
match against the three entries corresponding to logical CAM 624. If the message data 
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space 310 of this CAM input 314 starts with the string "123456", then it will match the 
first row of the CAM 304, causing the corresponding row 500a of RAM 320 to be 
returned to the decoder circuit 302. As provided in the field corresponding to column 
618, the op code of this RAM output 500a is "NTWK", which the decoder circuit 302 
recognizes as an instruction to forward the message. From column 622, RAM output 
500a also includes the value "35" in its instruction-specific information field 514, which 
the decoder passes along to the EARL for implementing re- write rule 35. Since the 
pattern matching engine 260 is finished with this message, the done flag 506 from 
column 620 of RAM output 500a is asserted, thereby confirming that processing is 
complete. 

If the message did not begin with the string "123456", then the second row or 
entry of the first logical CAM 624 tests whether the message starts with a "55". If so, 
there is a match and the decoder circuit 302 receives the corresponding row 500b of 
RAM 320 as a RAM output 500. From column 618, the op code for this RAM output 
500b is CONT. In response, the decoder circuit 302 moves the barrel shifter 308 by the 
offset specified from column 616 (e.g., "1"), thereby causing the barrel shifter 308 to 
slide one byte along the message and load the corresponding window into the message 
space 3 1 0 of CAM input 314. From column 614, the tag value of this RAM output 500b 
is "2", which the decoder circuit 302 loads into tag space 318 of the new CAM input 314. 

By virtue of its tag value (e.g., "2"), this new CAM input 314 is essentially 
matched against logical CAM 628, which searches for "65" anywhere in the message 
portion 310 of the input 3 14. If a "65" is found as shown in the first four rows or entries 
of logical CAM 628, then the corresponding row or entry 500i-5001 of RAM 320 is 
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returned to the decoder circuit 302. Each of these RAM outputs 500i-5001, moreover, has 
the CPU as its op code (column 618), an instruction-specific data of "2" (column 622) 
and an asserted done flag (column 620). Accordingly, the decoder circuit 302, in 
response to any of these RAM outputs 500i-5001, stops processing the message and sends 

5 it to the CPU with the instruction to execute subroutine "2". 

Returning to logical CAM 624, if the first CAM input 314 did not start with 
"123456" or "55", then it would still match the third row of logical CAM 624, which has 
the wildcard or don't care value at each data byte position. Accordingly, the 
corresponding row 500c of RAM 320 would be provided to the decoder circuit 302, and 

10 circuit 302, as directed by the CONT op code from column 61 8 of this RAM output 500c, 
continues searching the message. In particular, decoder circuit 302 slides the barrel 
shifter 308 one increment (e.g., 1 byte) along the message buffer 306, as directed by the 
"1" in offset column 616, so as to supply a new window to the message space 310 of the 
next CAM input 3 14. Decoder circuit 302 also loads the tag space 3 1 8 of this new CAM 

15 input 314 with the value "1", as directed by the "1" in the tag column 616 of this RAM 
output 500c. 

By virtue of the "1" in the tag portion 318, this next CAM input 314 is essentially 
matched against all of the entries or rows of logical CAM 626. It should be understood 
that each CAM input 314 is actually matched against all CAM entries, but by utilizing 
20 (e.g., setting) the tag space, matches can only occur to the entries of the selected logical 
CAM. Logical CAM 626 has been programmed to search for a "55" anywhere in the 
message space 314 of the respective input. If no "55" is found, the CAM input 314 will 
still match the last row of logical CAM 626 due to the use of the wildcard or don't care 
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value for each data word. The corresponding row 500h of the RAM 320 directs the 
decoder circuit 302 to move the barrel shifter 308, but keep the tag value at "1", 
essentially searching sequential windows of the message for an occurrence of "55". 
When a "55" is located, the respective RAM outputs 500d-500g direct the decoder circuit 
5 302 to move the barrel shifter 308 by an offset determined by the location at which the 
"55" is found and to change the tag value to "2", thereby comparing the next segment of 
the message with the entries of logical CAM 628 (i.e., searching for the occurrence of a 
"65"). 

If a "65" is located, the respective RAM outputs 500i-5001 for logical CAM 628 
10 direct the decoder circuit 302 to send the message to the CPU along with the identity of 
program number "2", as indicated in the data column 622. The last entries of logical 
CAMs 626 and 628 both have the end flag de-asserted as indicated at column 602. Thus, 
a match to these entries, which causes the decoder circuit 302 to continue searching, 
means that the barrel shifter 308 has not yet reached the end of the message. Upon 
15 reaching the end of the message buffer 306, the decoder circuit 302 preferably asserts the 
end flag 404 (Fig. 4) of the respective CAM input 314. Thus, if this last message portion 
310 fails to include a "55" or a "65", it will not match the last row of either logical CAM 
626 or 628 (which have their end flags de-asserted). Instead, this CAM input 314, 
carrying the last message portion, will only match the one entry of logical CAM 630. 
20 The respective RAM output 500n, moreover, directs the decoder circuit 302 to send the 
message to the CPU with an instruction to execute program number "1". 

As shown, appropriate programming of the CAM 304 and RAM 320 results in the 
desired actions or treatments being correctly applied to network messages. Furthermore, 
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the configuration of the pattern matching engine 260 of the present invention, including 
the decoder circuit and the CAM/RAM combination, allows an Ethernet frame payload 
(e.g., 1 500 bytes) to be checked in a matter of microseconds. In particular, by having 
multiple instances of decoder circuits, message buffers, etc. operating on CAM 304 and 
5 RAM 320, as described above, parallel processing can be achieved significantly 
increasing performance. 

Fig. 7 is a highly schematic partial representation of CAM 304 and RAM 320 
programmed to execute a particular subroutine, namely skipping over continuous blank 
spaces. As described above, CAM 304 and RAM 320 have a plurality of corresponding 
10 entries or rows which are organized into a plurality of fields by means of a number of 
common columns, including end column 602 tag column 604 and data column 605, 
which includes a series of data unit (e.g., byte) sub-columns 606-612 at CAM 304, and 
tag column 614, offset column 616, op code column 618, done column 620, and a rewrite 
subroutine column 632 at RAM 320. By virtue of the values stored in the entries of the 
15 tag column 604 (i.e., 100), this portion of CAM 304 corresponds to a logical CAM 634. 

Logical CAM 634 preferably operates as follows. Suppose the pattern matching 
engine 260 is programmed to search for a particular IP address and, upon locating that IP 
address, to continue searching for one or more URLs contained within the body or data 
portion of the message. Suppose further that following the IP address are a series of 
20 blank spaces of variable length. To quickly skip over the blank spaces and begin 

searching data for the URL, the pattern matching engine 260 preferably utilizes logical 
CAM 634. More specifically, upon locating the subject IP address, the respective RAM 
output 500 is a CALL action. The return tag sub-field contained in this RAM output 500 
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carries the tag corresponding to that portion of CAM 302 used to search for the desired 
URL. In accordance with the CALL operation, decoder circuit 302 pushes this return tag 
onto the subroutine stack 328. The decoder circuit 302 then generates a new CAM input 
314 for continuing its search of the respective message. In particular, decoder circuit 302 
5 directs the barrel shifter 308 to slide by one increment and load the corresponding 
window from message buffer 306 into the message space 3 10 of this new CAM input 
314. Within the tag space 318 of this new CAM input 314, decoder circuit 302 loads the 
tag specified in the tag value field of the RAM output 500. Since the pattern matching 
engine 260 is going to be utilizing the blank space skipping logical CAM 634, this tag 
10 value is preferably set to " 1 00". 

This new CAM input 3 14 is then provided to CAM 304. By virtue of its tag space 
318, input 314 can only be matched to the entries of logical CAM 634. If the entire 
contents of the message data portion 310 of this input 314 are blank spaces, represented 
in hexadecimal format as "20", then the input 314 will match for the first row of logical 
15 CAM 634. The action of the respective RAM output 500o is CONT, thereby directing 
the decoder circuit 302 to continue searching the message. Specifically, decoder circuit 
302 slides the barrel shifter 308 by four increments to retrieve a new window for loading 
into message space 310 of the next CAM input 314, as specified by the contents of the 
offset field corresponding to column 616, and leaves the tag portion of this new input 3 14 
20 set at "100". Accordingly, this next CAM input 314 is also matched against the entries of 
logical CAM 634. 

This process is repeated until the message data portion 310 of the CAM input 314 
includes data rather than blank spaces at any location. Rather than match the first entry 
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of logical CAM 634, which requires blank spaces at all data locations, such a CAM input 
will match entries 2-5 of logical CAM 634 depending on how many of the data locations 
carry data rather than blank spaces. As shown, the corresponding RAM outputs 500p- 
500s are all return (RET) actions. In response, the decoder circuit 302 "pops" the return 
5 tag that was previously pushed onto the subroutine stack, and uses this return tag in the 
tag space 318 of the next CAM input 314. As indicated above, this tag identifies the 
logical CAM used to search for the desired URL. Decoder circuit 302 also directs the 
barrel shifter 308 to slide along the message buffer 306 and retrieve a new window for 
use in loading the message data space 310 of this next CAM input 314. The amount by 
10 which the barrel shifter 308 is moved is specified in the offset field of the RET-based 
RAM output 500, which value is shown in column 616. In order to resume searching 
precisely where data resumes in the network message, the amount of the offset depends 
on where the last blank space was located. 

As shown, logical CAM 634 efficiently executes a desired subroutine, e.g., 
15 skipping blank spaces. 

It should be understood that CAM 302 is configured to identify the first matching 
entry as opposed to all matching entries. Thus, only a single RAM output 500 is 
provided to the decoder circuit 302 per CAM input 314. Nevertheless, this configuration 
makes ordering of the CAM (and thus RAM) entries significant during the programming 
20 of those devices. In general, more specific matches or rows should be placed ahead of 
less specific matches or rows (i.e., rows containing more wildcard or don't care entries). 

To the extent, a traffic flow utilizes dynamically agreed-upon destination and 

source ports, the pattern matching engine 260 can be programmed to identify such 
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agreed-upon port numbers so that subsequent messages corresponding to this traffic flow 
can be treated accordingly. For example, the initial network messages exchanged to set- 
up a given TCP session can be searched to identify the particular dynamic ports that are 
selected by the respective entities. These port numbers may then be programmed into the 
5 CAM 304 so that subsequent messages corresponding to this traffic flow can be easily 
identified. It should be understood that multiple messages may be provided to engine 
260 for pattern matching. For example, all of the initial set-up messages for a particular 
TCP session may provided to engine 260 for pattern matching. 

The foregoing description has been directed to specific embodiments of this 
10 invention. It will be apparent, however, that other variations and modifications may be 
made to the described embodiments, with the attainment of some or all of their 
advantages. For example, although the illustrative embodiment of the pattern matching 
engine 260 has been described in connection with the searching of network messages 
(e.g., TCP/IP packets and/or data link frames), those skilled in the art will recognize that 
15 it may be used to search other data records or files. Therefore, it is an object of the 

appended claims to cover all such variations and modifications as come within the true 
spirit and scope of the invention. 



What is claimed is: 
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CLAIMS 

1 LA pattern matching engine for use in searching network messages for pre- 

2 defined regular expressions and for determining matches thereto, the pattern matching 

3 engine comprising: 

4 a regular expression storage device for storing the pre-defined regular expressions 

5 and one or more corresponding actions that are to be applied to network messages 

6 matching the respective regular expressions, the storage device including a content- 

7 addressable memory (CAM) having a plurality of entries containing at least the pre- 

8 defined regular expressions; and 

9 a decoder circuit coupled to the regular expression storage device, the decoder 

10 circuit configured to control an input to the CAM that includes a given network message 

1 1 or selected portion thereof for comparison with the regular expressions contained within 

12 the CAM, and to receive and decode an output returned from the regular expression 

13 storage device, the output identifying the action to be applied to the given network 

14 message or portion thereof, 

15 whereby the CAM is configured such that each network message or portion 

16 thereof input to the CAM is compared against all CAM entries at the same time, allowing 

17 high-speed pattern matching of network messages. 

1 2. The pattern matching engine of claim 1 wherein each CAM entry further 

2 contains a tag such that all CAM entries having the same tag define a single logical CAM 

3 within the CAM, and further wherein the decoder circuit is configured to constrain the 
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4 matching of a given CAM input to the CAM entries corresponding to a selected logical 

5 CAM. 

1 3. The pattern matching engine of claim 2 further comprising a barrel shifter 

2 operatively coupled to the decoder circuit, the barrel shifter configured to provide a 

3 selected portion of a network message to the CAM input as directed by the decoder 

4 circuit. 

1 4. The pattern matching engine of claim 3 further comprising a second decoder 

2 circuit coupled to the regular expression storage device, and a second barrel shifter 

3 operatively coupled to the second decoder circuit, wherein the second decoder circuit and 

4 second barrel shifter apply a selected portion of a second network message to the regular 

5 expression storage device in parallel fashion with the decoder circuit and barrel shifter. 

1 5 . The pattern matching engine of claim 3 wherein the CAM input comprises a 

2 message data space for storing the network message or portion thereof provided by the 

3 barrel shifter, a tag space for storing the selected tag, and an end flag indicating whether 

4 the message data space contains a last segment of the respective network message. 

1 6. The pattern matching engine of claim 5 wherein the output returned by the 

2 regular expression storage device comprises an operation code for identifying the action 

3 to be applied to the respective network message and, to the extent further searching is to 

4 be performed on the respective network message, an offset for use in directing the barrel 
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shifter to select a new message portion for a subsequent CAM input and a tag to be 
appended to the subsequent CAM input. 

7. The pattern matching engine of claim 6 wherein the output further returned by 
the regular expression storage device further comprises a done flag, which, if asserted, 
indicates that processing of the respective message is complete. 

8. The pattern matching engine of claim 7 further comprising a pre-parser logic 
circuit configured to extract one or more selected fields from network messages received 
at the pattern matching engine and to append those selected fields to the respective 
network messages prior to inputting the messages to the CAM. 

9. The pattern matching engine of claim 8 wherein a first action output by the 
regular expression storage device is a call action that comprises first and second tags, and 
the pattern matching engine further comprises a subroutine stack coupled to the decoder 
circuit for temporarily storing the second tag while the respective message is searched 
under the first tag. 

10. The pattern matching engine of claim 8 wherein a second action output by the 
regular expression storage device is a counter action, and the pattern matching engine 
further comprises a counter memory coupled to the decoder circuit, the counter memory 
having one or more counters that may be selectively actuated by the decoder circuit in 
response to the counter action. 
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1 1 1 . The pattern matching engine of claim 8 wherein a third action output by the 

2 regular expression storage device is a copy action, and the pattern matching engine 

3 further comprises a message field memory coupled to the decoder circuit for storing 

4 information in response to the copy action. 

1 1 2. The pattern matching engine of claim 1 wherein the regular expression storage 

2 device further includes a second memory structure having a plurality of entries for storing 

3 the actions to be applied to the network messages, wherein each entry of the second 

4 memory structure is associated with a corresponding entry of the CAM and stores the 

5 action to be applied to network messages matching the regular expression of its 

6 corresponding CAM entry. 



1 13. The pattern matching engine of claim 12 wherein the second memory 

2 structure is a random access memory (RAM). 

1 14. The pattern matching engine of claim 1 3 wherein the CAM is a ternary 

2 content addressable memory (TCAM) that supports don't care values. 

1 1 5 . A method for searching network messages for pre-defined regular expressions 

2 in order to apply a selected action to network messages matching a given regular 

3 expression, the method comprising the steps of: 
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4 storing the pre-defined regular expressions in a content-addressable memory 

5 (CAM) having a plurality of entries; 

6 associating each CAM entry with the action that corresponds to the regular 

7 expression stored at the respective CAM entry; 

8 inputting a given network message or selected portion thereof to the CAM for 

9 comparison with all of the regular expressions stored therein; and 

10 identifying the action that corresponds to a first CAM entry matching the inputted 

1 1 network message or selected portion thereof. 



1 



16. The method of claim 15 wherein the step of associating comprises the step of 
S 2 providing a second memory structure having a plurality of entries for storing the actions 
f8 3 to be applied to the network messages, wherein each entry of the second memory 
° 4 structure is associated with a corresponding entry of the CAM and stores the action to be 

applied to network messages matching the regular expression of its corresponding CAM 



5 



6 entry. 



1 1 7. The method of claim 1 6 further comprising the step of appending a tag to the 

2 given network message or selected portion thereof that is input to the CAM, and further 

3 wherein each CAM entry contains a tag value such that all CAM entries having the same 

4 tag value define a single logical CAM within the CAM. 

1 1 8. The method of claim 17 wherein the CAM is a ternary content addressable 

2 memory (TCAM) and the second memory structure is a random access memory (RAM). 
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1 1 9. An intermediate network device for use in processing and forwarding network 

2 messages in a computer network, the intermediate network device comprising: 

3 a plurality of line cards, one or more of the line cards capable of being connected 

4 to portions of the computer network by respective communications media, each line card 

5 configured to receive and forward network messages; 

6 a message processing card; and 

7 a common bus that provides inter-communication between the plurality of line 

8 cards and the message processing card, wherein the message processing card comprises: 

9 pattern matching engine for use in searching network messages for pre- 

10 defined regular expressions and for determining matches thereto, the pattern 

1 1 matching engine comprising: 

12 a regular expression storage device for storing the pre-defined 

1 3 regular expressions and one or more corresponding actions that are to be 

14 applied to network messages matching the respective regular expressions, 

15 the storage device including a content-addressable memory (CAM) having 

16 a plurality of entries containing at least the pre-defined regular 

17 expressions; and 

lg a decoder circuit coupled to the regular expression storage device, 

19 the decoder circuit configured to control an input to the CAM that includes 

20 a given network message or selected portion thereof for comparison with 

21 the regular expressions contained within the CAM, and to receive and 

22 decode an output returned from the regular expression storage device, the 
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23 output identifying the action to be applied to the given network message or 

24 portion thereof, 

25 whereby the CAM is configured such that each network message 

26 or portion thereof input to the CAM is compared against all CAM entries 

27 at the same time, allowing high-speed pattern matching of network 

28 messages. 

1 20. The intermediate network device of claim 19 wherein each CAM entry of the 

2 CAM further contains a tag such that all CAM entries having the same tag define a single 

3 logical CAM within the CAM, and further wherein the decoder circuit is configured to 

4 constrain the matching of a given CAM input to the CAM entries corresponding to a 

5 selected logical CAM. 

1 21 . The intermediate network device of claim 20 wherein the pattern matching 

2 engine further comprises a barrel shifter operatively coupled to the decoder circuit, the 

3 barrel shifter configured to provide a selected portion of a network message to the CAM 

4 input as directed by the decoder circuit. 

1 22. The intermediate network device of claim 2 1 wherein the pattern matching 

2 engine further comprises a second decoder circuit coupled to the regular expression 

3 storage device, and a second barrel shifter operatively coupled to the second decoder 

4 circuit, wherein the second decoder circuit and second barrel shifter apply a selected 
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5 portion of a second network message to the regular expression storage device in parallel 

6 fashion with the decoder circuit and barrel shifter. 

1 23 . The intermediate network device of claim 22 wherein the CAM input 

2 comprises a message data space for storing the network message or portion thereof 

3 provided by the barrel shifter, a tag space for storing the selected tag, and an end flag 

4 indicating whether the message data space contains a last segment of the respective 

5 network message. 

1 24. The intermediate network device of claim 23 wherein the output returned by 

2 the regular expression storage device comprises an operation code for identifying the 

3 action to be applied to the respective network message and, to the extent further 

4 searching is to be performed on the respective network message, an offset for use in 

5 directing the barrel shifter to select a new message portion for a subsequent CAM input 

6 and a tag to be appended to the subsequent CAM input. 

1 25. A pattern matching engine for use in searching network messages for pre- 

2 defined regular expressions and for determining matches thereto, the pattern matching 

3 engine comprising: 

4 means for storing the pre-defined regular expressions and one or more 

5 corresponding actions that are to be applied to network messages matching the respective 

6 regular expressions, the storage means including a content-addressable memory (CAM) 

7 having a plurality of entries containing at least the pre-defined regular expressions; and 
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means, coupled to the storage means, for decoding actions returned from the 
storage means, the decoding means configured to control an input to the CAM that 
includes a given network message or selected portion thereof for comparison with the 
regular expressions contained within the CAM, and to receive and decode an output 
returned from the storage means, the output identifying the action to be applied to the 
given network message or portion thereof, 

whereby the CAM is configured such that each network message or portion 
thereof input to the CAM is compared against all CAM entries at the same time, allowing 
high-speed pattern matching of network messages. 



48 

\\CHEETAH\VOL1\CLIENTS\112\025\0174\PROSECUT\0174.DOC 03/24/00 10:01 AM 



PATENT 
112025-0174 



ABSTRACT OF THE DISCLOSURE 

A programmable pattern matching engine efficiently parses the contents of 
network messages for regular expressions and executes pre-defined actions or treatments 
on those messages that match the regular expressions. The pattern matching engine is 

5 preferably a logic circuit designed to perform its pattern matching and execution 

functions at high speed, e.g., at multi-gigabit per second rates. It includes, among other 
things, a message buffer for storing the message being evaluated, a decoder circuit for 
decoding and executing corresponding actions or treatments, and one or more content- 
addressable memories (CAMs) that are programmed to store the regular expressions used 

10 to search the message. The CAM may be associated with a second memory device, such 
as a random access memory (RAM), as necessary, that is programmed to contain the 
respective actions or treatments to be applied to messages matching the corresponding 
CAM entries. The RAM provides its output to the decoder circuit, which, in response, 
decodes and executes the specified action or treatment. 

15 
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this application: None . 

I hereby declare that all statements made herein of my own knowledge are true 
and that all statements made on information and belief are believed to be true; and further 
that these statements were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment or both under Section 1001 of 
Title 18 of the United States Code and that such willful false statements may jeopardize 
the validity of the application or any patent issued thereon. 
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